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We study an irreversible Markov chain Monte Carlo method based on a skew detailed balance 
condition for an one-dimensional Ising model. Dynamical behavior of the magnetization density 
is analyzed in order to understand the properties of this method. As a result, it is found 
theoretically that the relaxation time of the magnetization density is reduced by using some 
transition probabilities satisfying the skew detailed balance condition, in comparison to that 
with the corresponding transition probability with the detailed balance condition, and that one 
of the transition probabilities changes the dynamical critical exponent even with a local spin 
update. 
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1. Introduction 

Markov chain Monte Carlo (MCMC) methods have 
been widely used for sampling from a high-dimensional 
probability distribution and for estimating expectation 
values under the distribution. Since Metropolis et al. 
have proposed a MCMC method as a simulation tool for 
studying liquid,^) it has been applied to various prob- 
lems in physics as well as other research fields. The con- 
ventional MCMC methods, such as Metropolis-Hastings 
algorithm^^ and heat-bath algorithm, have developed 
within the framework of the detailed balance condition 
(DEC), which ensures the existence of stationary dis- 
tribution in a Markov chain. It is, however, not always 
necessary to make the MCMC method work correctly. 
MCMC methods which are not based on DEC have been 
discussed for improving the performance and, in fact, 
some MCMC methods without DEC have recently been 
proposed. 

In the MCMC method, the convergence to the target 
distribution is guaranteed by using an irreducible and 
aperiodic Markov chain, characterized by a transition 
matrix. It is known that the rate of convergence of the 
distribution depends on the second largest eigenvalue of 
the transition matrix of the Markov chain. Eecause all 
the eigenvalues are real if the transition matrix satisfies 
DEC, an estimator converges to its asymptotic value ex- 
ponentially. On the other hand, if the transition matrix 
does not satisfy DEC, some eigenvalues could be com- 
plex in principle and then the estimator behaves like a 
damped oscillation. Such dynamics may affect the effi- 
ciency of performance of MCMC methods. 

Let us consider the efficiency of the MCMC method. 
When one estimates the expectation value {O) of an ob- 
servable O precisely, Monte Carlo steps M should be 
sufficiently large, depending on an actual algorithm and 
a probabilistic model to be studied, so that the empirical 
distribution converges to the target distribution. Then, a 
MCMC method is considered to be efficient if an estima- 
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tor rapidly converges to an exact expectation value and 
the variance of the estimator is sufficient small. The vari- 
ance of the estimator is often enlarged by the correlation 
between samples in the Markov chain, which inevitably 
appears in return for overcoming the curse of dimension- 
ality in MCMC methods. The correlation between sam- 
ples is evaluated from an integrated autocorrelation time 
'Hnt.G defined by the autocorrelation function C{t] O):^^ 



ri„t,o = ^C(t;0)=^ 



(1.1) 



where Oi is the value of O at z-th Monte Carlo step 
(MCS) and C{t;0) does not depend on i after the sys- 
tem reaches equilibrium. The effective variance of the 
estimator is given as a'^g ^ ~ (1 -I- 2rint,o)co, where CTq 
is the variance in the case of independent sampling. The 
correlation time Tint,© increases with increase of the cor- 
relation between samples. Consequently, the number of 
effective samples decreases as M^e — + 2Tint,o)- 

Thus, the efficient MCMC method requires the reduc- 
tion of the variance or the correlation time. 

In the Markov chain with DEC, Peskun's theorem pro- 
vides us a guiding principle for constructing an efficient 
MCMC method. According to the theorem, the asymp- 
totic variance of any observable is reduced by decreasing 
the rejection rate of the Markov chain. From this point 
of view, it turns out that the Metropolis transition prob- 
ability is more efficient than that used in the heat-bath 
method. However, this argument relies on DEC and no 
guiding principle has been established in the case of the 
MCMC methods without DEC. It is therefore of great 
concern how MCMC methods are constructed without 
the use of DEC and how the methods improve the ef- 
ficiency of performance. For instance, Suwa and Todo 
have proposed a MCMC method without DEC,'^^ which 
brings several times of reduction in the correlation time 
of the Potts model, in comparison to the corresponding 
method with DEC. Turitsyn et al.^^ and Fernandes and 
Weigel^^ have also proposed other MCMC methods with- 
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out DBC and have suggested from numerical simulations 
that the dynamical critical exponent may be changed in 
a mean-field Ising model. Although these numerical stud- 
ies cncoiu-agc to use the MCMC methods without DBC, 
it is not well understood theoretically how these meth- 
ods aflfect to the dynamics, particularly in statistical- 
mechanical models. 

In this paper, we discuss the dynamics in the Markov 
chain without DBC in an one-dimensional kinetic Ising 
model, which is exactly solved in the Glauber dynam- 
ics with DBC.^) By solving time evolution of the order 
parameter for the model, it is found that some transi- 
tion matrices yield the reduction of the relaxation time 
which significantly depends on the choice of the transi- 
tion probability. 

The paper is organized as follows. In §2, static and dy- 
namic properties of the one-dimensional Ising model are 
surveyed. In §3, an irreversible Markov chain based on 
the skew detailed balance condition is constructed for the 
Ising model and dynamical behavior of the magnetization 
density is analyzed in the Markov chain. An outline of 
our MCMC simulation is described and their results are 
presented in §4. Finally, summary and discussions are 
given in §5. 

2. Reversible Glauber Dynamics 

Glauber dynamics is a Markov chain of configuration 
of an Ising model. In this section, we survey the Glauber 
dynamics of an one-dimensional Ising model with DBC^^ 
in order to fix our notation. 

2.1 Ising model in one dimension 

We study the one- dimensional Ising model with no ex- 
ternal magnetic field. A state of the Ising model is de- 
noted by a vector <t = (cti, • • • , crjv) with aj = ±1 being 
an Ising variable defined on j-th site. The Hamiltonian 
is defined as 



N 



(2.1) 



where a periodic boundary condition is imposed as 
C7JV-I-1 = CTi and J is the exchange interaction constant. 
For a given inverse temperature j5, in the units where 
Boltzmann constant is 1, the cquilibriiim distribution 
7r(cr) for finding a state cr is proportional to the Boltz- 
mann factor exp (— /3'H(cr)). 

An expectation of an observable A = A(a) in equilib- 
rium is expressed as 



(2.2) 



where denotes the summation over 2^ spin configu- 
rations. The order parameter of the Ising model is mag- 
netization density which is given in our notation by the 
expectation {m)^^ of the observable m{a) = j^^jUj. 
It is well known that no spontaneous magnetization 
emerges at any finite temperature and the phase transi- 
tion does not occur in the one-dimensional Ising model, 
that is 



for all N and /3 > in this model. The correlation length 
^(/3) is given by 

r'(/3) = -log(tanh^J), (2.4) 

which diverges as the temperature goes to zero. 

2.2 Master equation and detailed balance condition 

Since the Ising model has no intrinsic dynamics in- 
duced by Hamiltonian, a stochastic dynamics introduced 
by Glauber*^ has been used in the study of dynamics of 
the Ising models. The stochastic dynamics is a Markov 
chain of the state cr, which is described by a master equa- 
tion. 

We define Fj be a spin-flip operator on j-th site; Fjcr 
is the state that j-th spin is flipped from cr with the oth- 
ers fixed. The Markov chain is characterized by a transi- 
tion probability Wj{cr) per unit time from cr to FjCr. Let 
p{cr,t) be a probability distribution for finding the spin 
state cr at time t. Then, the master equation is written 
as follows: 



dt 



p{(T,t) 



p{a,t) 



+ Y.'^j{Fj<=')p{Fj<^,t), (2.5) 



where the first and second terms in the right hand side 
are outgoing and incoming probability, respectively. 

For the master equation in Eq. (2.5), the necessary and 
suflacient condition that p(<T, t) converges to the equilib- 
rium distribution 7r(cr) as t — >^ oo is that the transition 
probability Wj{a) satisfies a balance condition (BC): 

Wj{a)n{a) = J2 ^jiFjcrMFj'^)- (2-6) 

3 3 

In practice, DBC is widely used for a suflacient condition 
of BC: 



(2.7) 



This condition is also called reversibility in the field of 
statistical science. The sequence of states generated by 
the transition probability with DBC is called reversible 
Markov chain. While BC means the total balance of the 
stochastic flow in the state space, DBC requires a local 
balance of the stochastic flow between each state tr and 
FjCr. Imposing DBC, some transition probabilities can 
be determined explicitly and have been used in MCMC 
simulations. For instance, Glauber's transition probabil- 
ity is given for the one-dimensional Ising model as 



1 



Wj{cr) = -a 



1 - ^-fcrj{(jj-i+aj+i) 



(2.8) 



where a is a time constant and 7 = tanh2/3J. This 
is equivalent to the heat-bath algorithm in MCMC 
method.^) 



(rn)eq = 0, 



(2.3) 
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2.3 Time evolution of magnetization density 

An expectation of an observable A at time t is denoted 
by 



(2.9) 



From the master equation in Eq. (2.5), time evolution of 
the magnetization density is reduced to*^ 

l^(m{t)) = -il-7){mit)). (2.10) 
a at 

Then, we have 

{m{t)) = (m(0)) exp[-a(l - ^)t]. (2.11) 

This indicates that the magnetization density con- 
verges exponentially in time to the equilibrium value in 
Eq. (2.3). The relaxation time of the magnetization den- 
sity which reflects the rate of convergence is deflned as 

(m(t))-(m) 
T / at- — — , , ^ . (2-12) 



/o (m(0))-(m)^q- 

Using the solution of Eq. (2.11), the relaxation time of 
this system is obtained as 

1 



Q!(l -7)' 



(2.13) 



which means that the convergence rate is slower with 
decreasing temperature and eventually diverges at zero 
temperature 7 = 1. This is due to dynamical slowing 
down induced by the zero-temperature transition. For 
7^1, one finds that r ~ using Eq. (2.4) with the 
dynamical critical exponent z = 2. 

2.4 Integrated autocorrelation time 

We also discuss an integrated autocorrelation time of 
the magnetization density. Let p{(T,t + t^lcr' ,tu) be a 
conditional probability for finding a state cr at elapsed 
time t after a state cr' at waiting time t^- Then, an au- 
tocorrelation function of an observable A in equilibrium 
is defined as 

(2.14) 



{A^aA(t)) - (AY 



where 



{A^qA{t)) := ^ A{cT')TT{cT')A{(T)p{(T,t + t^\(T',t^), 



(T,(T' 



(2.15) 

where t^i being a sufficient long time. In the case of the 
magnetization density, substituting Eq. (2.11) we have 

(meqm(t)) = (m') exp[-a(l - j)t]. (2.16) 



Combining with Eq. (2.3), we obtain 

Ceq{t;m) = exp[-a(l - 7)^]. 



(2.17) 



Thus, the integrated autocorrelation time of the magne- 
tization density is obtained as 



which is identical to the relaxation time of the magnetiza- 
tion density. This indicates that the correlation between 
states in the Markov chain increases with temperature 
decreasing and consciquently the effective variance of the 
magnetization density is enlarged. 

3. Irreversible Glauber Dynamics 

A stochastic process whose transition probability does 
not satisfy DBC is called irreversible Markov chain. In 
this section, we construct a Markov chain for the one- 
dimensional Ising model on a basis of skew detailed bal- 
ance condition (SDBC)*' and study time evolution of the 
magnetization density under SDBC. 

3.1 Master equation and skew detailed balance condi- 
tion 

According to the method of Turitsyn ct al.,^^ wc intro- 
duce another Ising spin e = ±1 in addition to the original 
spin configurations. The enlarged state of the system is 
denoted by X := (f,e) G {—1,-1-1}^'''^. We consider a 
single spin-flip update for the whole spin including e as 
an elementary Markov process. Let p{cr, e, t) be a prob- 
ability distribution which we flnd a state (<r, e) at time 
t. The master equation of the system is given as follows: 



d_ 
di 



p{cr,e,t) = - 



p{cr,s,t) 



— A(cr, e)p{cr, e, t) 
-fA(cr, -e)p{(T, -e,t), 



(3.1) 



where Wj {cr, e) is a transition probability par unit time 
from a state (<T,e) to {Fjcr,e) and \{cr,e) is that from 
a state (cr,e) to (cr, — e). We assume that an equilibrium 
distribution of the master equation is independent of the 
additional spin e: 

y{cr,e), p(cr,e,t) — > i7r(cr) as t 



00. 



(3.2) 



Therefore, the balance condition (BC) is given by 
j 

+ [X{a,e) - X{(T,-e)]TT{a) =0. (3.3) 

In order to determine the transition probabilities 
Wj{cr,e) and A(cr,e) satisfying BC in Eq. (3.3), we im- 
pose an alternative condition: 

Wj(cr,e)7r(cr) = Wj{FjCr, —e)Tr{FjCr). (3.4) 

This condition is referred as the skew detailed balance 
condition^^ which requires a local balance of stochas- 
tic flows from a state (cr,e) to {Fja,e) and that from 
{Fjcr,—e) to (<r, — e). Under SDBC, the condition for 
A(cr,£) is obtained from BC in Eq. (3.3) as 



r°° 1 

^'-'''"''■^i rfiC'e<i(t;m) = ^^^, (2.18) x{a,s) - X{a,-e) = Y,['^M,-s) -w,{a,s)]. (3.5) 

j 
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The condition in Eq. (3.5) combined with SDBC ensures 
that the probabihty distribution converges to the equi- 
Hbrium distribution in the Markov chain. 

There still remains the degree of freedom for determin- 
ing the transition probability iUj{cr,e) even when SDBC 
is imposed. In the present work, we choose a Glauber like 
transition probability 



Wj (cr, e) 



1 



1 



1 - oT'^i('^J-i 



(1 — deaj 



(3.6) 

where i5 is a parameter which characterizes the devia- 
tion from DEC. Note that DBG is reduced to the case 
of (5 = and the range of the parameter 5 is restricted 
to the interval [—1,1] because of the non- negativity of 
Wj{cr,e). The transition probability in Eq. (3.6) is equiv- 
alent to the heat-bath transition probability in the one- 
dimensional Ising model with virtual magnetic field eH 
with 5 = tanh/3i?. However, it should be reminded that 
SDBG leads to the equilibrium distribution of the system 
without the magnetic field given by Eq. (3.2). 

Using the transition probability in Eq. (3.6), the con- 
dition in Eq. (3.5) is rewritten as 



A(cr, e) — X{cr, —s) = aS{l — ~j)Nem{a). 



(3.7) 



There are variations in A(cr,e) satisfying the condition 
of Eq. (3.7). In this work, we discuss the following three 
types of the transition probabilities: 

1 - 7m(<t) + (5(1 - 7)£m(<T)l , (3.8) 



-aN 
2 



and 



A(cr,e) = ia(5(l-7)iv(l+em(cr)), (3.9) 



A(cr,e)=max 0, a5{l - -i)N£m.{cr) , (3.10) 



where u{cr) — j^'Ylij'^j'^j+T-- We refer the first transi- 
tion probability of Eq. (3.8) as Sakai-Hukushima 1 (SHi) 
type. Because the condition of Eq. (3.5) means that a 
difference between A(cr,£) and A((T, — e) is equal to that 
of the summation of Wj{(T,e), A(cr,£) of the SHi type 
is assigned to one of the summation terms. The sec- 
ond transition probability of Eq. (3.9), referred as Sakai- 
Hukushima 2 (SH2) type, is obtained by imposing that 
A(<T, e) is a linear function of e. Then, the non-negativity 
of X{(T,e) further restricts the range of 6 to [0, 1]. This 
transition probability is specific to the Ising model in 
one dimension. The transition probability of Eq. (3.10) 
is constructed by allocating all of the right hand side of 
Eq. (3.5) to either A(cr,£) or A(cr,— e). Since this tran- 
sition probability has been proposed originally by Turit- 
syn et al.,^) we call it Turitsyn-Ghertkov-Vucelja (TGV) 
type. 

3.2 Exact solution in the SHi type 

We discuss time evolution of the magnetization density 
under the SHi type transition probability in this subsec- 
tion. An expectation of an observable A = A{(7, e) of this 



system at time t is redefined from Eq. (2.9) to 

{A{t)) := E E ^' (3-11) 

e=±l cr 

From the master equation in Eq. (3.1), differential equa- 
tions for the magnetization density and the expectation 
of the additive spin e are obtained as 

{m{t)) = -(1 - 7) {m{t)} + 6 (sit)) <57 {suit)) , 

a at 

(3.12) 

m) = -S{1 - l)N {m{t)) - N {s{t))+jN (suit)) , 

a at 

(3.13) 

respectively. By combining Eqs. (3.12) and (3.13), we 
have 

a dt 

for large A''. Thus, we obtain 

(m(i)) = (m(0)) exp[-a(l + 5'^){l - 7)*], (3.15) 
and the relaxation time is given as 

1 



(m(i)) = -(l + <5^)(l-7) [mit)).. 



(3.14) 



(3.16) 



q(1 + ,52)(1 -7)- 

The autocorrelation function is calculated as well. Let 
p(cr, e^t A- t^\(T' ,e' ,t^) be a conditional probability that 
we find a state (<t,£) at elapsed time t after an equi- 
librium state (cr',£') is given at t^. Then, Eq. (2.15) is 
extended to 

{A,^A{t)) = 5] ^ A(^',£')i7r(cT')A(a,£) 

xp{a,s,t + t^\(T',e',t^). (3.17) 

Therefore, we have 

Ceq(t; m) = exp[-a(l + 6^){1 - j)t], (3.18) 

and the integrated autocorrelation time defined by 
Eq. (2.18) is obtained 

1 



'nnt,m — 



(3.19) 



a(l + J2)(i-^)- 

As in the case of DBG discussed in the previous sec- 
tion, the relaxation time and the integrated autocorrela- 
tion time of the magnetization density coincide with each 
other. It is shown analytically that they are reduced by 
introducing SDBG in the case of the SHi type. Interest- 
ingly, it is found that the DBG point {6 = 0) is the worst 
efficient in this case. The reduction of the relaxation time 
from DBG is constant and independent of temperature. 
Therefore, the dynamical exponent does not change from 
that in DBG by using this type of transition probability 
satisfying SDBG. 

3.3 Approximate analyses in the SH2 type 

In this subsection, we discuss another transition prob- 
ability A(cr,£) given by Eq. (3.9). The differential equa- 
tion for the expectation of the additive spin e is replaced 
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from Eq. (3.13) to 

m) = -S{1 - 7)N {mit)) - 6(1 - j)N {e{t)) , 

a at 

(3.20) 

while that for the magnetization density is identical to 
Eq. (3.12). It is difficult to solve the differential equation 
because of the existence of the higher order term {eu{t)) 
in Eq. (3.12), which differs from the case of SHi type. It 
is reasonably assumed 

{eu{t))^{e{t)){u)^^, (3.21) 

when the system is in the vicinity of the equilibrium 
state. Under the assumption, Eq. (3.12) is rewritten as 

^1 ("^W) = -(1-^) {m{t))+SVT^{eit)) , (3.22) 

where (w)^,^ = tanh/3J = (1 — vl — 7^)/7 for large A^. 
By combining Eqs. (3.20) and (3.22), we obtain 

{m{t)) = (m(0)) exp[-Q!(l - 7 + 5^/l-"f^)t]. (3.23) 

Note that this result could be valid if the initial state is 
near the equilibrium point. Using Eq. (3.23), we have the 
autocorrelation function as 

Ceq(i; m) = exp[-a(l - 7 + 5^/T^)t], (3.24) 

and the integrated autocorrelation time is 

^i"t'™ = -J, \ n 2\ - ^^-^^^ 

a(l - 7 + ov 1 ~ 7 ) 

This expression is different from that obtained in the SHi 
type. The relaxation time is not an even function of the 
parameter 5. However the parameter takes the value of 
[0, 1] in this type. Hence, it is also found that the case 
of DEC with (5 = gives the worst efficiency in the pa- 
rameter range. Further, the gain from the DEC point 
significantly depends on temperature and the dynamical 
critical exponent z is down to 1 in this type of transition 
probability of e flip. While some mimerical works suggest 
the reduction of the dynamical critical exponent by us- 
ing non reversible transition probability,^' ^-^ the present 
study shows analytically that the specific type of irre- 
versible transition probability makes the relaxation of 
the magnetization density accelerated and changes the 
dynamical critical phenomena. 

3.4. Linear analyses of time evolution near equilibrium 

point 

As seen in the previous section, an irreversible transi- 
tion probability yields the reduction of dynamical crit- 
ical exponent. Non-local update such as cluster algo- 
rithm^' ^"^^ often leads to such acceleration of dynamics. 
It should be noted that even a local spin update changes 
the dynamical properties of system by using the irre- 
versible transition probability. However, the irreversible 
transition probability does not always make the signifi- 
cant changes as seen in §3.2. It turns out that the transi- 
tion probability for e fiip plays an important role for the 
dynamics of the spin configuration. 

In this subsection, we stiidy dynamical trajectory of 
the magnetization density and the expectation of the 




Fig. 1. Schematic picture of dynamical behavior of {m(t)) and 
{s{t)) in the vicinity of the equilibrium point at origin for the 
transition probability of the SHi and SH2 types. Bold solid line 
represents a slowest mode of the dynamics along which the set of 
estimators approaches to the equilibrium point soon after start- 
ing from an initial point ((m(0)) , (£(0))). 



additive Ising spin near equilibrium point in the case 
of the SHi type and SH2 type. Under the assumption in 
Eq. (3.21), the difi^erential equations of these estimators 
can be solved for the SHi type in a thermodynamical 
limit 

(m(t)) = (m( 0))exp ha(l + d^){l - j)t], 
{s{t)) = (m(0)) exp[-a(l + 5'){1 - ^)t], 

(3.26) 

and for the SH2 type 

f (m(t)) = (m(0))exp[-a(l -7 + (5Vl -72)t ], 
\ (e(i)) = - (m(0)) exp[-a(l - 7 + 6^/T^)t]. 

(3.27) 

These solutions arc represented as a dynamical trajectory 
in the parameter space of {m{t)) and {s{t)), where the 
equilibrium point is the origin (0, 0). Using linear analysis 
at the equilibrium point, it is found that these expecta- 
tions converge to the equilibrium point (0,0) along by 
a straight line, which can be regarded as an eigenvector 
of the slowest mode of the dynamics. Figure 1 shows a 
schematic picture of the trajectory. In the case of DEC, 
{s{t)) is an irrelevant parameter and thus the magne- 
tization density {m,{t)) converges to zero along by the 
horizontal axis. A finite slope of the asymptotic line is a 
consequence of the irreversible transition probability. In 
fact, the solutions in Eqs. (3.26) and (3.27) provide the 
estimate of the slope as —6^J (1 — 7)/(l -|- 7) for the SHi 
type and —1 for the SH2 type. The slope for the SHi 
type decreases with temperature decreasing and eventu- 
ally goes to zero at zero temperature, 7=1. Namely, the 
dynamics near zero temperature is essentially equivalent 
to that in DEC. Presumably, this is the reason why the 
transition probability of the SHi type does not change 
the dynamical critical phenomena. On the other hand, 
the slope for the SH2 type is independent of tempera- 
ture and quite different from that for DEC. This implies 
that the relaxation dynamics to the equilibrium state 
with SDEC is accelerated by using the extended state 
including the additional e spin. 
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Fig. 3. (Color online) 7 dependence of the relaxation time of the magnetization density with the parameter 5 varying. The chosen 
values of parameter in the simulations are N = 2"^, a = 10-2, 7 = 0.6, Afens = iC^ and M = 2.5 X 10^. The transition probability 
used is the SHi, SH2, and TCV types from left to right, respectively. The solid lines in the left panel for the SHi type represent the 
theoretical results. 



4. Monte Carlo simulations 

In this section, we explain a procedure of the MCMC 
method with SDBC for the one-dimensional Ising model 
described in the previous section. Let X{n) be a state of 
the system after n steps. Then, the elementary procedure 
of discrete time evolution in our simulation is as follows: 

(a) Set an initial condition X{0) arbitrary. 

(b) Suppose that the state X{n) — {cr,e) at time n and 
choose a spin aj from cr at random. 

(c) Accept the new state as X{n + 1) = {Fjcr, e) with the 
probability Wj{cr,e). If it is rejected, accept X{n + 
1) = (cr, — e) with the probability 

A(^,s) = -4^^^^. (4.1) 

If also rejected, set X{ti + 1) = X{n). Then, return 
to (b) and repeat the steps (b)-(c). 

It is proven that these steps satisfy BC. We consider N 
steps of (b)-(c) as one Monte Carlo step (MCS). In this 
work, the initial condition X{0) is fixed as Cj = +1 for 
all j and e = ±1 is chosen at random. 



In this method, an expectation of an observable A = 
A{<T,e) at time t is estimated as 

(A(t))^-— ^A(^'(0,£Xi)), (4.2) 

where ((T'(t), £*(t)) is a state of i-th trajectory at t-th 
MCS starting from the initial condition and A^cns denotes 
the number of simulated trajectories. Figure 2 shows the 
time dependence of the magnetization density estimated 
by Eq. (4.2) for the transition probabilities discussed in 
the previous sections. The relaxation time of the magne- 
tization density under the transition probability is esti- 
mated as 

1 

r:^-^(m(t)), (4.3) 
t=i 

where M is the total number of MCS. Figure 3 shows 
the 7 dependence of the relaxation time of the magneti- 
zation density with the parameter S varying. From Fig. 2, 
it turns out that the magnetization density decays expo- 
nentially in time and it converges to zero rapidly with 
increasing S in the case of all three types. In particular, 
in the case of SHi type, this is completely consistent with 
the results of Eq. (3.15) for N and a used in the simula- 
tions. Moreover, the numerical estimation of relaxation 
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Fig. 4. (Color online) Time evolution of autocorrelation function of the magnetization density in the one-dimensional Ising model for 
different values of S. The chosen values of parameter in the simulations are N = 2"^, a = 10-2, 7 = 0.6, Atolls = 10^. The transition 
probability used is the SHi, SH2, and TCV types from left to right, respectively. 
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Fig. 5. (Color online) 7 dependence of the integrated autocorrelation time of the magnetization density with the parameter 5 varying. 
The chosen values of parameter in the simulations are N = 2'^, a = 10-2, 7 = 0.6, Ncns = 10^ and M = 2.5 X 10^. The transition 
probability used is the SHi, SH2, and TCV types from left to right, respectively. The solid lines in the left and middle panels represent 
the theoretical results. 



time, shown in the left panel of Fig. 3, is consistent with 
the theoretical estimate in Eq. (3.16). 

The autocorrelation function and the integrated auto- 
correlation time are also calculated. Let t^j be a sufficient 
large integer which ensures equilibrium of the system. 
Then, the autocorrelation function of the magnetization 
density is estimated as 

{m,qm{t)) - -— J2 m{(THt^))m{(T'{t + t^)), (4.4) 

z— 1 

and the integrated autocorrelation time of the magneti- 
zation density is 

1 ^ (meqm(t)) - {m)l^ 

where here M is the total number of MCS after steps 
and the equilibrium values of {m)^^ and (™^)j,q are used. 
Figures 4 and 5 present the numerical results estimated 
by Eqs. (4.4) and (4.5), respectively. As seen in the mag- 
netization density, the autocorrelation function also de- 
cays to zero exponentially in time and the relaxation is 
accelerated by increasing 5 for three cases. MC results re- 
cover the theoretical solutions of Eqs. (3.18) and (3.19) 
for the SHi type. Further, the approximate solution for 
the SH2 type describes well Tint,™ obtained by the MC 



simulation, including that 5 dependence of Tint.m disap- 
pears at zero temperature limit with anti-ferromagnetic 
interaction, 7 = — 1. This confirms numerically that the 
transition probability of the SH2 type changes the dy- 
namical critical phenomena. For the TCV type, an oscil- 
lating behavior of the autocorrelation function is clearly 
observed in the right panel of Fig. 4 and consequently 
the integrated autocorrelation time is reduced more sig- 
nificantly than that for the other types. This implies the 
existence of complex eigenmode in the relaxation dynam- 
ics, discussed later. 

As an illustration of the intrinsic dynamics with 
SDBC, we show the data of trajectory {{m{t)) , (e(t))) in 
Fig. 6 for the SHi and SH2 types. In both cases, the slope 
of the asymptotic line near the equilibrium observed in 
Fig. 6 coincides with the theoretical prediction discussed 
in §3.4. A deviation from the straight line is found far 
from the equilibrium point. This is due to the effect of 
high-order correlation, approximated to Eq. (3.21) in our 
analysis, for the SHi type and due to the finite size effect 
for the SH2 type, which disappears in the thermodynam- 
ical limit. 

5. Summary and Discussion 

We have studied dynamics of the one-dimensional Ising 
model in a class of the irreversible Markov chain, where 
the SDBC, instead of DEC in the reversible Markov 
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Fig. 6. (Color online) Trajectory of {{m{t)) , (e(t))) from the initial condition (1,0) to the equilibrium point (0,0) for the SHi type 



(left) and the SH2 type (right). The chosen values of parameter in the simulations are A' 
M = 2.5 X 10'^. Solid lines represent the asymptotic lines near the equilibrium. 
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Fig. 7. (Color online) Time evolution of the magnetization den- 
sity for several sizes A'^ with the TCV transition probability. The 
chosen values of parameter in the simulations are a = 0.05, 
7 = 0.6, S = 0.9 and Mens = 10^. 



Fig. 8. (Color online) Trajectory of ((m(t)) , {e(t))) from the ini- 
tial condition (1,0) to the equilibrium point (0,0) for the TCV 
type. The chosen values of parameter in the simulations are 
N = 2"^, a = 10-2, 7 = 0.6, Nena = 10^, and M = 2.5 x 10^. 



chain, ensures the existence of the stationary distribu- 
tion in a long-time hmit. In particular, the relaxation 
time of the magnetization density and its autocorrelation 
function have been discussed for three different transition 
probabilities satisfying SDBC, called the SHi, SH2 and 
TCV types, in which the parameter 6 controls the de- 
viation from DBC. In the case of SHi and SH2 types, 
we have obtained theoretical results of the dynamical 
behavior of the magnetization density and have revealed 
that the relaxation time and the autocorrelation time are 
always reduced for non-zero parameter S. Furthermore, 
we have shown that the SII2 type transition probability 
changes the dynamical critical exponent while the SHi 
type does not. 

Some arguments in the previous sections can be made 
for more general Ising models in high dimensions. Sup- 
pose that the Hamiltonian of the Ising system is given 
as 

n{(T) = - ^ j,k<j,<Jk - J2 (5.1) 

where Jjk denotes an interaction between Uj and and 
Hj is a local magnetic field acting on aj. The transition 
probability Wj{a,e) for the spin flip discussed here is 



given as 

Wj{cT,e) = (1 — (Tjtanh/3£'j) (1 — Seaj) , (5.2) 

where Ej = J2k Jjk<^k + Hj is a local field on j-th site, 
including the one-dimensional model as Jjk = JSkj+i- 
This satisfies SDBC and is reduced to the ordinary 
Glauber transition probability when S = 0, which has 
been studied. If the transition probability of the SHi 
type is used for the e fiip, the magnetization density 
obeys 

(5.3) 

for large N. This indicates that the SHi type yields only 
the change of time constant from a in DBC to a{l + <5^) 
in SDBC. Hence, the relaxation time is reduced up to 
the factor 1 + 6^ from DBC, independent of temperature, 
even when the system exhibits a phase transition at finite 
temperature in more than two dimensions. Although it 
is not certain if this argument is valid for other observ- 
ables, this argument suggests the existence of a class of 
transition probabilities in the irreversible Markov chain 
which yields a finite gain, temperature independent, in 
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the relaxation time compared to that of the correspond- 
ing transition probabihty with DEC. 

Finally, let us discuss the eigenvalue in the irreversible 
Markov chain. Although all eigenvalues of a Markov 
chain with DBG are real in general, it is considered that 
whether an eigenvalue is real or complex depends on how 
to choose transition probabilities if the Markov chain 
does not satisfy DBC. In the method of SDBC which 
we consider in this paper, several choices of a transi- 
tion probability 'Wj{eT,e) satisfying SDBC in Eq. (3.4) 
are possible in general. Even if Wj{(T,e) is fixed, we can 
choose some transition probabilities A(cr, e) satisfying the 
condition in Eq. (3.5), such as the SHi, SH2, and TCV 
types. As discussed in §3, it turns out that the eigenvalues 
which affect to the dynamical behavior of the magneti- 
zation density are all real in the case of the SHi type. 
However, numerical simulations for the one-dimensional 
Ising model with other transition probabilities show dif- 
ferent dynamical behavior of the magnetization density. 
For instance, in the case of SH2 type, the magnetiza- 
tion density converges exponentially in time observed in 
the middle panel of Fig. 2. On the other hand, the exis- 
tence of complex eigenmode in the relaxation dynamics 
is strongly implied from numerical simulations in §4 for 
the TCV type. Figure 7 shows time evolution of the mag- 
netization density for several system sizes A'', indicating 
that the complex eigenvalues clearly depend on N and 
the imaginary part decreases with A^. 

Unfortunately little is known about the dynamics in 
the TCV type analytically. According to Turitsyn ct al.,'') 
a change in the dynamical critical exponent is induced 
in the mean-field Ising model with the use of the TCV 



type In fact, as seen in §4, the transition probability of 
the TCV type provides the largest reduction of the relax- 
ation time. This may be explained in the dynamical tra- 
jectory shown in Fig. 8. The asymptotic slope, which is 
not derived analytically, is almost vertical, quite far from 
the horizontal axis in the case with DBC. Therefore, fur- 
ther theoretical studies for the MCMC methods without 
DBC are of prime importance to clarify the mechanism 
which induces the change of dynamics. 
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